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BANDWIDTH OPTIMIZATION FOR 
FREQUENCY SHIFT KEYING 

by 

James C. Morakis 
Goddard Space Flight Center 


SUMMARY 

The behavior of a frequency shift keying detector as a 
function of bandwidth has been analyzed for four types of band- 
pass filters, and bit error probability curves have been plotted 
for each of the four filters with the bandwidth as the variable. 
The four filters are: (a) a dump type, (b) a sharp type, (c) a 

combination of a and b, and (d) a singly tuned high Q filter. The 
purpose of this paper is to bring out the variation of optimum 
bandwidth as the assumptions about the system vary. Another 
significant result is the unbalance of the probability of error 
due to different binary combinations, and consequently, the 
dependence of the average probability of error on just the prob- 
ability of error of two out of 2 k combinations. 
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BANDWIDTH OPTIMIZATION FOR 
FREQUENCY SHIFT KEYING 


by 

James C. Morakis 
Goddard Space Flight Center 


INTRODUCTION 

The bit error probability at the output of a frequency shift keying (FSK) receiver of the type 
shown in Figure 1 is y(e~ E/2N o) (Reference 1) under the following assumptions: 

a. The noise is white Gaussian. 

b. The mark and space frequencies are sufficiently separated so that the cross-correlation 
between any two of the two signals and the noise in the two filters is zero. 

c. The filters are exactly matched. (These filters have an output which is proportional to the 
cross-correlation of the inverse in time of the filter impulse response which must be made equal 
to the expected waveform.) 

d. The detector is an envelope detector which follows the envelope and the signal very closely. 

e. The type of FSK (continuous or discontinuous phase at the time of frequency change) is not 
specified. 

f. The s/N is large. 

g. The filters are free of intersymbol interference. 


In an actual system most of these assumptions are approximately valid, but some assumptions 
are completely unjustifiable. Consequently, for most practical systems, the above quoted bit 
error probability is a lower bound. 


It is possible to choose some of the pa- 
rameters in such a manner so as to optimize 
the system, but there are some parameters 
which are contradictory. For example, let us 
take assumption (c) which states that the fil- 
ters are matched. A matched filter for FSK 
implies two filters centered at frequencies f x 



Figure 1 — The FSK defector. 
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and f 2 , respectively, provided the separation of these two frequencies is large enough to reduce 
the interchannel interference to zero. 

Furthermore, the filter bandwidth, B, is assumed to be small to reduce the noise and cross- 
talk and yet not too small to cause signal distortion (intersymbol interference). This paper shall 
retain the assumptions that can be readily justified; and varying the remaining assumptions we 
shall generate four different types of filters. 

Succeeding sections of this paper will describe the system, and present a preliminary glimpse 
of the problem, by investigating the effects of bandwidth on each of the different types of inter- 
ference (considering the remaining interferences as nonexistent). This preliminary simple anal- 
ysis will serve two objectives: (a) the knowledge of the range of some variables that will enable 
us to make some realistic assumptions, and (b) a better insight into the problem. 

Following the bandwidth effect investigation is a section devoted to the derivation of the bit 
error probability as a function of the (S/N) in and the filter characteristics for the four different 
filter types. Throughout the text the variable nBT is used. However, if T is given, B may be found 
for any given value of ttBT . 

SYSTEM DESCRIPTION 

The system under consideration is shown in Figure 1. The filters are high Q singly tuned 
circuits; however, by varying their bandwidth, shape and center frequency, we will effectively 
obtain four types of filters. In any of these types, the envelope detectors employ full wave recti- 
fiers, and the comparator compares the two outputs at the sampling instant as dictated by the 
sampler output, which occurs at the maximum signal to interference ratio. 

We will frequently reach a point where some complexities may be simplified if we know the 
dynamic range of some variables involved. To gain this knowledge some preliminary analyses 
must be conducted under simplified conditions. 

THE EFFECT OF BANDWIDTH ON DIFFERENT TYPES OF INTERFERENCE 

The three main types of interference are noise, intersymbol and interchannel (crosstalk), and 
although their sources are varied, these quantities depend on one common variable, the bandwidth. 
For example, the noise power n is given by: 

/•CO 

N = N 0 |H(o))| 2 d6; % BN 0 

•'-CO 

where N 0 , a constant (assuming white noise), is the noise power per unit bandwidth (cycle), and B is 
the 3-db bandwidth of the bandpass filter, or the bandwidth of the equivalent rectangular filter so 
far as noise power is concerned. 
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The crosstalk is of the form signal/D; where 


D; 


(“I +1 ) BT 


+ 1 


(i / j . i, j - 1, 2) 


da) 


and the intersymbol interference is measured by the "spread beyond the bit period" of the impulse 
response of the equivalent low-pass filter. This is shown to be (Appendix A) 


Ce _7TBT 

where c is a proportionality constant and B is the 3-db bandwidth. 

Since the effects of bandwidth variation on adjacent channel, noise, and intersymbol interfer- 
ence are opposing, it will be necessary to study those effects separately by assuming only one 
interference at a time. 


Effect of Bandwidth on Intersymbol Interference 

The response of a singly tuned bandpass filter and envelope detector combination to an ampli- 
tude modulated step signal of the form U(t) sin cot is (Appendix B) 


y(t) = < 


i - 


Po 


j3 

7tBT ) +4 -JT e -77 


[(£“ co) t + v/r - 0] 


P<? ~ - 2 

2 TT B CO 


+ 1 


(lb) 


For f3 0 = j3 and co = j3 0 , (or no frequency offset), Equation lb becomes: 


y(t) = 1 - e^ BT (1c) 

Note that this result is identical to the one which would have been obtained if the result of Ap- 
pendix A was used. 

Assuming no crosstalk and no noise , the signal at the outputs of the two filters is shown in 
Figure 2 for the four cases of a 3-bit signal in improving order. These sketches demonstrate the 
effect of intersymbol interference alone, for bt = 0.41. 
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The calculation of the difference of the out- 
puts of the mark and space envelopes depends 
on the type of sequence received. For example, 
the four cases (in order of improvement) for the 
3-bit words of Figure 2 are listed below. 

Table 1 


Three-bit Words at Detector Outputs. 


Sequence 

Difference Between 
M&S Detector (y 2 - y 2 ) 

a 

001 or 110 

1-2 exp(-TrBT) + exp(-37rBT) 

b 

101 or 010 

1-2 exp(-TrBT) + 2 exp(-277BT) 
- exp(-37rBT) 

c 

Oil or 100 

1-2 exp(-27rBT) + exp(-37rBT) 

d 

111 or 000 

1-2 exp(-377BT) 


To optimize the system for the worst case, 
replace K{y 1 -y 2 )/N by the expression of Equa- 
tion 2 and then obtain the maximum of that ex- 
pression which occurs at ttbt = 2.5. This result 
may be checked by observing the maximum of 
curve 3 in Figure 3. 

y t - y 2 = c(l-2e-” BT + e-3" BT ) (2) 


M * 1 - ( 1 - e‘ 2a ) e‘° 

M-l-[l-(l-e‘ a ) e"°] 

S - (1 - e' 2a ) e -0 

S- [l - ( 1 - e"°) e" a ] e'° 

M - S * 1 - 2e'° + 2e~ 3a 

M-S - 1 - 2e‘° + 2e‘ 2a - 2e 



M ■ 1 - (1- e"° ) e _2a M - 1 - e _3 ° 

S - ( 1 - e -a ) e _2 ° S - e _3a 

M-S -1- 2e' 2o + 2e-*° M - S ■ 1 - 2e _3a 



Figure 2— Approximate waveforms at the output of mark 
(solid line) and space (broken line) detectors and their 
difference for three-bit words, (a) SSM. (b) MSM. 
(c) SMM. (d) MMM. 


The Effect of Bandwidth 
on Noise and Crosstalk 

When the intersymbol interference is zero,* 
the noise and crosstalk are proportional to the 
bandwidth so the S/N increases as B decreases. 

This effect is illustrated in Figure 3 where 
the expression of Equation 3a representing this 
case is plotted as curve 1. 



y i ~ y 2 = c{l-e-^)(i-±)/jB (3a) 


VARIABLE BANDWIDTH (ttBT) 

Figure 3— The plot of 1/2 (Y, + Y s ) vs. ttBT. 


•This is true if the filter is of the integrate and dump type. 
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Description of the Different Outputs 


When a sequence of zeros and ones (each represented by one of the frequencies f l9 f 2 ) is 
applied to the mark filter, the output will be a mixture of f f 2 , and their cross products. One 
is then confronted with the problem of finding the envelope of the sum of waveforms of different 
frequencies. The two difficulties in this problem are: (a) the nonlinearity of the envelope detector 
and (b) the sensitivity of the output on the relative phase of the different input frequencies. 

This section is devoted to the solution of the dynamic range of some of the variables so that 
valid assumptions may be made in a later part of this section. Therefore, let us now define and 
obtain expressions for the different signals that contribute to the output of the detector. 

The response of the mark filter to a mark signal applied at t = 0 is the main signal, and it is 
represented by y 110 *. The amplitude of the main response is obtained by setting a> = /3 = a > 1 in 
Equation B9 or using Equation BIO of Appendix B. 


yi.i.o * 1 " de-" BT ; d % 1 (3b) 

The response of the space filter to a mark signal applied at t = 0 is the crosstalk, which is rep- 
resented by y 0 ,i,o 5 an ^ its amplitude fluctuates between the two extreme values of 


1 + de' TrBT 
y o,i,o ~ D 


(3c) 


This has a frequency 


~^i 
2 TT 


nf r 


(3d) 


where D is the crosstalk factor defined in Equation 8e, and f D is the data bit frequency. 

The response of the mark filter to mark signals applied at t < 0 is the crosstalk and is [from 
Equation Bll with t = - <k+ i)T]: 


y t , _ k = (l-de-" BT ) de- BkT . 


(3e) 


♦For y x j i = 1,0 and refers to the mark (1) and space (0) filters. 

j = 1,0 and refers to the mark (1) and space (0) signals, 
k = -2, -1, 0 and refers to the sampling interval. 
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Finally, the response of the mark filter to a space signal applied at t < 0 is called the crosstalk 
intersymbol interference; and its amplitude fluctuates between the two values: 




1 ± de" 7 ^ 

D 


^g-n-BkT 


(3f) 


When k is an integer, the sampling may occur at the minimum of the expression for crosstalk, 
thus reducing the expressions to ones involving only the negative sign. Four more definitions may 
be generated from the above definitions by interchanging the words "Mark" and "Space." 

Treating the effects of the mark and space frequencies as two vectors of comparable amplitude 
but different frequency; the average value of the resulting vector is the square root of the sum of 
the squares, since the two vectors are orthogonal. This is, incidentally, the justification for the 
form of Equations C7 and C8 of Appendix C. 

Assumptions 

The preliminary analysis of this section has revealed the following results: 

a. Under no crosstalk assumptions, (equivalent square filter), the optimum value of ttbt is 
between .6 and 2.6. However, since the optimum value of ttbt for the worst case is 2.5, we will 
assume tt&t to be no larger than 2.5. 

b. The effect of intersymbol interference will be far more serious than that of crosstalk for 
the filters that will give the value of BT discussed in (a). 

In view of the above results we choose to make the following assumption for later analysis: 

a. The noise is white Gaussian. 

b. The mark and space frequencies are separated by an amount equal to nf D . If this spacing 
is further increased, the probability of error will be lowered, the crosstalk will be lowered, and 
the optimum bandwidth will occur at a higher value of ttBT. 

c. The filters are singly tuned high Q filters located at = 2 rri x and = 2^f 2 . 

d. The envelope detector follows the envelope of the signal very closely (a full wave rectifier 
helps). 

e. The change in subcarrier frequency occurs at the zero crossings. 

f. The signal-to-noise ratio is fairly large to justify the use of the following expression 
(Reference 2) in this system: 


p , X -cE/2N 0 

P e 2 6 


(4) 
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BANDWIDTH OPTIMIZATION 


Expressions for the Probability of Error 

The objective of bandwidth optimization will be pursued by minimizing the probability of error. 
This, however, is a function of the signal -to-noise ratio, and this ratio depends on the input se- 
quences.* The probability of error (P e ) for a given sequence is given by: 

P e = P(M) P (an M will be detected as an s) 

+ P(S) P (an S will be detected as an m) (5) 


The average probability of error for K admissible sequences is then: 

K 

P ave. = J2 P ( lth SeqUenCe )( P e)i ' (6a) 

i=l 

If all the binary sequences of length k are admissible, Equation 6a becomes 


P 


ave. 



(6b) 


Equation 6 is a summation of 2 k terms where k is the filter memory in bits. Theoretically, k 
should be infinite, but for the time constants found previously, (1.6 < 77 BT), k should not be larger 
than 3. So for k = 3 we obtain the 3 -bit sequences identical to those in Table 1. 

For P(M) = P(S) = 1/2, P(M/S) = P(S/M) , and large S/N , the bit error probability for nonco- 
herent FSK is given by Equation (4) with c = 1/BT , the reciprocal of the bit period-noise bandwidth 
product. The system becomes optimum by setting B = l/T ; this maximizes the S/N and reduces 
the expression of Equation (4) to the familiar 

1 e -E/2N 0 (4) 

where E is the signal energy per bit and N 0 is the one sided noise spectral density. 


♦This effect may be observed in Figure 2. 
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We shall optimize B by keeping E in /N 0 a parameter, and T constant. The exponent then becomes 


Eout 1 _ 77 ^in /y 1 y 2 \ 

"So BT = ’ 

where E in (y 1 -y 2 ) 2 = E out at the k th sampling instant (t = kT) . 

Returning to Equation 6, we find that it expands to the form (using k = 3) 


<P> 




i=l 


I ^/2( E in/"o) Y i 2 

8 /_ i 2 6 
i = l 


(7) 


where 


Y ; = 


y i - y 2 


(8a) 


Generalized Signals at the Detector Output 

Since y t - y 2 will vary for each of the 2 k (8 in this case) inputs, we must calculate for each 
input. For k = 3, the inputs are: 

Input number 1 is 001 Input number 5 is 110 

Input number 2 is 101 Input number 6 is 010 

Input number 3 is 011 Input number 7 is 100 

Input number 4 is 111 Input number 8 is 000 


Now using Equation C7 of Appendix C we generate Equation 8b that expresses the eight generalized 
outputs corresponding to the above inputs.* 


Y 1 

= 

f (yi,o,- 2 ’ yi.o.-i- yi,i,o)~ 

^ (y 2 , o,- 2 ’ y 2 ,o.-i’ y 2l i.o 

Y 2 


f (yi.i,- 2 * y i,o,-r yi.i.o)’ 

f (y 2 , i,- 2 ’ y 2 , o.-i* y 2l i, o 

Y 3 

= 

f (y i . o,- 2 ’ y i , i , -r y i , i , o) ~ 

f ( y 2, 0,-2’ y 2, 1,-1’ y 2, 1,0 

y 4 

= 

f ( y i, 1,-2’ y i, 1,-1’ y i, 1 ,0 ) ” 

f (y 2 , i,-2’ y 2 , i , -i’ y 2 , i , o 

Y S 

= 

f (yi,i,- 2 ’ yx.i.-i’ y i,o t o) + 

f (y 2 , i,- 2 ’ y 2l i,-i* y 2 , o, o 

Y 6 

= 

f (yi,o,- 2 ’ yi.i.-r yi.o.o) + 

f (y 2 ,o,- 2 ’ y 2 .i.-i’ y 2 ,o,o 

Y 7 


f (yi,i,- 2 ’ yi.o.-i* Yi.o.o) + 

f( y 2,l,-2’ y 2 ,0,-1’ y 2,0,0 

Y 8 


f ( y i, 0 ,- 2 ’ yi.o.o) + 

^( y 2 ,0,-2’ y 2 ,0,-1’ y 2,0,0 




> (8b) 


*y q r s is the output of the q filter due to a signal of type r applied s sampling periods ago. 
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1 -d x e“ a 

dj 2 (e 2a + e~ fl ) 2 

1/2 

1 -d 2 e _a 

i 2 / _ ~ 2 9 i * — a \ ^ i ^ 

ys 

L 

ys 

d 2 ( e + e a ) + — 

L 2 _ 


1/2 


1 - dj e -a 

d 2 (e-) 2 

+ (l + dj e -2a ) 2 

1/2 

1 ~ d 2 e“ a 

2 (l + d e“ 2a ) 

|6 

D l 2 

yi 

d 2 2 ( e ) + D 2 
2 

1 - dj e -a 

"d^ (e _2a ) 2 

+ (l + dj e _a ) 2 

1/2 

l-d 2 e” a 

, > 2 ( 1 + d 2 e " a ) 2 

vs 

D i 2 

y® 

d 2 ( e ) + n 2 
2 


1/2 


1/2 


> (8c) 


1 - d e" a 1 - d, e-“ fl + d, e -a + d, e' 2a ' 

yS [l + d i e a + di e“ 2a ] — _ 


1 " d 2 e" 


Va 


d 2 2 (e“ a + e _2a ) 2 


1/2 


°2 2 


+ 1 


1 " dj e“ 


yS 


di 2 ( e - 2a +e -a) 2 1 


D i 2 


where 


Y 1 (with subscripts 1 and 2 interchanged), 
Y 2 (with subscripts 1 and 2 interchanged), 
Y 3 (with subscripts 1 and 2 interchanged), 
Y 4 (with subscripts 1 and 2 interchanged), 


(8d) 


°i - ( m i + 1) 2 ( i ?) + 1 _ 


i = 1, 2 


a » ttBT , 


fix 

Ct >„ 


2 


(8e) 


’ ^ f D n 


d, = 


/5i 


i = 1, 2 
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Generation of the Four Types of Filters 


The particular results for each of the four filters may be obtained by using the results of 
Appendix D with d 1 - d 2 = l. 

Case 1 : Dump Filter With Large Subcarrier Separation ( D 2 , D s » 1 ) 

1 - <T a 

Yi = — for i = 1, 2, 3, 4, 5, 6, 7, 8 . 

ys 


Case 2: Dump Filter 



Case 3: Sharp Filter {D v b 2 » 1 > But No Dumping) 
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Case 4: Singly Tuned Filter (Actual Case) 
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PROBABILITY OF ERROR P. 


Comparative Performance of the Four Filters 

The average probability of error for each of the four cases is: 


Case 1: Dump Filter With Large Sub carrier Separation 

i 

Applying Equations 7 and 9, we find 


<P> = 


1 -CY. 2 

2 e 


(13a) 


Case 2: Dump Filter 

Applying Equations 7 and 10, we find 


<P> 


1 

2 


-CY, 


+ 


_1 

2 


e 





(13b) 



Case 3: Sharp Filter 

Using Equations 7 and 11, we find 


<P> 



-cy r 
+ e 4 


) 



+ P, 


+ P 4) 


(14) 


Case 4: Singly Tuned Filter 

The use of Equations 7 and 12 does not 
simplify Equation 7 because in this case each 
Y is different. However, due to the exponential 
dependence of P. on Y. , the only significant y t s 
are the two smallest (Figures 4 and 5) i.e., Y x 
and Y s in cases 3 and 4. Consequently, for a 
<1.6 one may safely say than for all cases 

<p> = i(p.*p s ) = It.-'' 1 *.- c '0 us) 


Figure 4— Probabil ity of error P e plotted against 
77 BT for the singly tuned filter case. 


if Y x and Y s are of comparable magnitudes, 
then one could obtain some insight as to the 
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VARIABLE BANDWIDTH (ttBT) 



Figure 5 — The plof of Y; vs. ^BT for 
the singly tuned filter case. 


Figure 6— Bit error probability vs. ^BT 
for an (S/N) in of 13 db. 


behavior of <p> for the four cases by examining the variation of (y x + Y^/2, as is done in Figure 3. 
The above conjecture is proven true by observing in Figure 4 that for a <1.6 


P + p 

1 _5 



(16) 


The relations expressed by Equations 12, 13, 14, and 7 and 12 are plotted in Figures 6 and 7 for 
S/N = 13 and 16 db, respectively. From Figures 6 and 7 one may observe that the optimum 77 BT 
for a singly tuned filter varies from 1.6 (n = 1) to 2.3 (n = <»). The optimum ttBT for a dump type 
filter varies from .8 to 1.3. 

The locations of the minimum P e are affected very little by the (S/N) in . 


DISCUSSION 


The average probability of error for the FSK system described in Figure 1 is given by Equa- 
tion 5 as 


<p> = £p(i)(P e)i - . 

i=l 1=1 


( 17 ) 
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AVERAGE BIT ERROR PROBABILITY 


where Y A is a function of the binary sequence 
input of length k. Each Y. is in turn a function 
of two important parameters, the intersymbol 
interference and the crosstalk. 

The intersymbol interference becomes 
evident as the sum of one or more terms of 
the form e _ka as seen in Equation 8c. 

The crosstalk is in the form of a factor 
multiplied by i/d 2 2 or i/d x 2 , depending on 
whether this crosstalk is referred to the mark 
or space filter. 

For large D, i/d . is inversely proportional 
to n, the ratio of the frequency separation of 
the shift frequencies to the data rate. 

For normal values of a and n Equation 12 
yields curves 4 (Figures 3, 6, and 7) which 
represent the actual case of a singly tuned 
filter. 

In curve 3 of these figures, n is allowed 
to approach infinity, which is equivalent to 
either increasing the separation so that 
(f i - f 2 ) / /f D is very large, or using very sharp 
filters (rectangular in the limit) with n in the 
order of 5. Either of the above techniques 
will eliminate crosstalk and is equivalent to 
n - 

In curve 2 of these figures, n is back to normal but the exponential terms are eliminated, 
giving us the case of no intersymbol interference usually accomplished by dump filters. Finally, 
curve 1 of these figures represents the case of no crosstalk and no intersymbol interference. 

The relations resulting from the above modifications are given by Equations 9 through 12. 

It would be of interest to examine the asymptotic relations of the above four cases. 

As a approaches zero , l/D i - 0 and 

X — 0 a / as a 2 \ 

(a) Y £ = lim — = lim #^ 1 - 2 T + 3 T" + ***J ~ 0 a = 7 tBT (18) 

for cases 1 and 2 and for all i. 



Figure 7— Bit error probability vs. t^BT 
for an (S/N) in of 16 db. 


14 



(b) Yi approaches zero for cases 3 and 4 in a similar manner as seen from the respective 
Equations 9 through 12. 

The similarities indicated in part (a) for curves 1 and 2, and in (b) for 3 and 4 are demonstrated 
in Figures 3, 6, and 7. The explanation lies in the fact that for very small values of a, intersymbol 
interference is solely responsible for the behavior of the output. Consequently, 1 and 2 may be 
classified as similar in the fact that they are both independent of intersymbol interference. On 
the other hand, curves 3 and 4 both depend on intersymbol interference, and therefore, vary simi- 
larly at low values of a. 

As a approaches infinity , a similar behavior may be observed for curves 1 and 3, and for 
curves 2 and 4 for large values of a. The explanation this time lies in the fact that for large a, 
the behavior of the curves is mainly influenced by crosstalk. 

In summarizing the filter performance, one may reclassify these four filters in this manner: 

(a) The filter of case 2 is of the dump type, thus completely eliminating the intersymbol 
interference. 

(b) The filter of case 3 completely eliminates subcarrier crosstalk. 

(c) The filter of case 1 is both sharp and of the dump type, thus combining all the good quali- 
ties of filters 2 and 3. Consequently, this filter is superior to both filters 2 and 3, as seen in 
Figure 3, with data for filters 2 and 3 being the lower bounds at the extreme points of the figure. 

(d) The filter of case 4 is a singly tuned filter with no dumping. This filter is inferior to 
either filters 2 or 3, the data for which are the upper bounds at the extreme points of Figure 3. It 
is of interest to notice that the optimum ttbt for this filter occurs at approximately the crossover 
point of filters 2 and 3, in Figure 3. 


CONCLUSIONS 

The results of this study are graphically shown in Figures 6 and 7, from which the following 
conclusions may be drawn. 

For a given n (subcarrier separation to data rate ratio) the dump type filters are superior, 
and the optimum ttbt ranges from .8 at n = 1 to 1.3 at n = 

Similarly the optimum ttbt for a singly tuned filter ranges from 1.6 (n = 1) to 2.3 (n = °°). 

The values of 77 BT, corresponding to the minimum points of the six curves in Figure 6, are 
approximately the same of those in Figure 7, indicating very little dependence of the minimum 
points on the (S/N) in . 

The improvement obtained by the transition from n = 1 to n = 2 is almost as much as the 
improvement from n = 2 to n = co. This implies that although an increase in n (or equivalently the 
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use of sharper filters) will improve the system, one should not use n f s larger than 3 as the im- 
provement above this point is of no real value. 

Another conclusion that may be drawn from Figures 4 and 5 is the unequal weights of the 
probabilities of error due to the different inputs (p 2 , . . . , P 8 ) , and specifically the proximity of the 
( P i +F s)/ S curves to the (P> curve. 

This inequality of the P^s and the fact that the main contributions to <P) are derived from 
only two out of eight inputs for a certain range of ttbt suggests a possible improvement in the 
system by controlling the source symbol probability. 

(Manuscript received January 14 , 1965 ) 
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Appendix A 


A Low-Pass to Band-Pass Filter Equivalence 

This appendix is to show the equivalence of the envelope of the response of band-pass filters 
to an amplitude modulated signal, with the response of an equivalent low-pass filter to the envelope 
of the amplitude modulated signal (Figures Ala and Alb). 


S in - m (t) COS 6J c t 

BPF, 

y 0 - S Q (t) cosai c t 

envelope 



BM 


detector 



(a) 


S in ” m W- 


LPF, 

LM 


So (0 


(b) 


B(a>) - + L* ~ Cl> c) 

Figure Al— Band-pass to low-pass equivalence. 


Preliminary Examination 


{Re H(<U)} = H(W) + H* (co) (Al) 

If H(s) is the transfer function of a physically realizable network, it is a positive real function.* 
If cr = 0, then H(s) may be represented by 


H(*0 


A{» + jBQ) 

C (CO) + ]D(o;) 


where A, C are polynominals of even powers of a; and B, D are functions of odd powers of H(>) is 
also 


A (co) + jc^N (CO) 

H(-) = C(*0 + jo<sM 


*Re{H(s) > 0} if cr > 0 where s - cr + ja>. 
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where all A, N, c, G are polynomials of even powers of co. Rationalizing this function, we 
have 


H(«) 


[AC + o> 2 NG + j W(NC - AG)] 
C 2 + co 2 G 2 


(A2) 


Thus one may express H(^) as a function of the polynomials Pj , P 2 , P 3 of even powers of co, so 


P x («) + j“P 2 («) 

H(“) " P s (a>) Ef") + iO(«) • 


Then 


H* («) 


Pj (<y) - jcuP 2 (o) 

P 3 <") 


where P(&>) - P( ~co) if p is a polynomial of even powers of co. 
Adding H(&>) and its conjugate yields 


H(W) + H* (co) = 2Re {h<»} • 


(A3) 


(A4) 


(A5) 


The conclusion of the above preliminary examination is that the real part of H(^) is equal to 
one half the sum of H<» and its conjugate. 


Examination of High- Q Band-Pass Filter 

Consider the high Q band-pass filter B(gj) which is symmetrical amplitude-wise [| B(/3 + a) | = |B(/S-a)|] 
and antisymmetric phase-wise [<£(") = 4> 0 (co - fi) ~ <o- jf\ about some frequency. 

The transfer function of such a band-pass filter may be expressed in terms of a low-pass 
filter as: B(^) = L(«-/3> +L* (- «-/3) . 

The impulse response of B(&>) then becomes 


b(t> = F" 1 {b(<w)} 



B(<a) e>"‘ df 


2 TT 



L (co ~ /3) e ia)t da; 


+ 



(- co - /3) e da; 


(A6) 
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If x - eo - p and y - - co- j3 9 then 


b(t) 


277 



L(x) e^ x+ ^ t dx 


+ 



(y) e ~ *<*+&* 



(A7) 


Letting the variable y-x, we have 


b(t) 


277 



L(x) e i ( x+ ^) t dx 


+ 


£ 


L (x) e 


-j(x+/3) 


dx 


e(t)e^ t + e*(t)e“^ t 


= 2Re {e(t) e J ^ } ' 


(A8) 


Conclusion: 

If e( t ) is considered as a complex envelope of the impulse response of the bandpass 
filter b(t), then this envelope is the inverse Fourier transform of the equivalent low pass 
filter. 

Now we may prove the equivalence of the two cases illustrated in Figure Al. The response 
in Figure Alb is: 


S 0 (t) 


I” 


e(T) m( t - r ) dr , 


(A9) 


where 


e(r) 


x 

277 



L(oj) e^ T d co . 


(A10) 
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For the case of Figure Ala: 


f 


y 0 (O = b ( T ) S in (t -T) dr 


J tCD 

b(r) m( t - r ) Re {e J ^ c(t T) } dr 
o 


= 2 


/»00 

Re {e(T) e^ T } m( t 

Jo 


") Re {e J c(t T) } dr 


/+CD 

i t 

J 0 


e(r) e^ T + e* (r) e~^ T j [e' 


j^ c ( t - T ) i -ja*(t-ry 
+ e 


] dr 


if 

*>0 


e(r) e J ^ ct m(t- r) e J ^ dr + ^ 


r°° 

2 e*(r)e i c m(t + r)e j ^ C ° c ^ r dr 

Jo 


if 


+ I e(r) e j ^ ct m(t -r) e^' 


r co 

^ )T dr + \ J 

JQ 


e*(T)e-^ t m(t-r)e- i( "-^ )T dr. (All) 


When y 0 (t) is passed through an envelope detector, it virtually eliminates the higher frequen- 
cies and if w c = fi , then 

i r r 

y o (*) = 2" e ( T ) e JC " ct m(t -r)dr +y e* (r ) e’ J&ct m(t - r) dr 

J o J 0 


Re {e(r) e J ct } m(t -r) dr 
Jn 


(A12) 


If e(r) is real f then 


y 0 ( 4 ) 


COS OJ c t 


f 

Jo 


e(r) m( t - r ) dr 


(A13) 


and 


S 0 (t) 


f 

•'O 


e(r ) m( t - r ) dr . 


(A14) 


'This implies symmetry of B(oj) about /3 or high Q. 
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For a singly tuned circuit of Figure El (Appendix E) 


B(*0 


j 2afrJ 

- a; 2 + 2j o/jj + J3£ 


- j 2aaj 

(a> + /3- ja) (w-/3- ja) 


- a(a + j/3) a(a~ j/?) 

+ {3 - j a) + {3(a) - {3 - ja) 


(A15) 


where 


/S 2 


4? 


1 

a 2RC 




1 

ycc ' 


So we have as a result 


B(«) 


a (a + j/ 3 ) , g(°- ~ j/3) 

&J - jS + j a) £(a>-/3-ja) 


(A16) 


The first term may be identified as L* (-a>-/3) and the second term as L(co-/3); so 


L(o,) 


<*(<* - j/3) 
ja) 


(A17) 


Then 


e(t) 


a( ja + /3) 1 f e ialt da> 

/3 277 J j(a)-ja) 

** —00 


a(ja+/3j e~ at J_ P d(a> - ja) d&) 

P 277 J j(co-ja) 


-ft (j a +/3) e" 


(A18) 


For a high Q circuit a « /3 and 


e(t) - ae" at 


(A19) 


which is identified as the impulse response of a low pass filter with a time constant equal 
to 2RC. 
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Appendix B 

The Step Response of a Singly-Tuned Circuit 


The usefulness of the step response of a singly tuned circuit becomes apparent when rectan- 
gular envelopes are used as inputs. 

For example, let S in (t) = rect (T) sinwt where 


rect (T) 


U(t) 

U(t) - U(t -T) = 0 


0 < t < T 
t > T 


and sin cot is replaced by its exponential form. 
The Laplace Transfoim of the Input is 


S(s) 



dt 


2j 


[rect (s 


j co, T) ” rect (s + j co, T)] 


l Pi - e -(s-jw)T i _ e -(s + jw)T 

2j |_ s ~ jco ~ s+jcj 


CO 

s l 2 + CO 2 


5 2 + CO 2 


[s sin coT + cos a/f] 


(Bl) 


The first term is the beginning of the rectangle and the last term is the end of the rectangular 
wave. For 0 < t < T the second term vanishes. 

Response for o <t <T 


Y(s) = S(s)H(s) 


co 2as 

s 2 + co 2 (s +a) 2 +/3 2 


Expanding by partial fractions yields 


co 2cts 

s 2 +co 2 (s+a) 2 +/3 2 


As + B + C ( s + a 0 ) 
s 2 +o) 2 (s+a) 2 +/3 2 


(B2a) 


(B2b) 
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where 


Then y(t ) is* 


where 


A = 


2a co(/3 2 -o?) 

(/3 0 2 -O) 2 ) 2 + 4a 2 c 


2a "(/ 3 o 2 " a ' 2 ) 
~ K 2 


B = A 


2aco 2 


C = - A 




_2^o 2 


2 - ,,i2 


B 

y(t) - A cos wt + — sin wt + 


C [(a 0 -a) 2 + /3 2 ] 1/2 

e at sin (/3t + 0) 


\p - tan" 


"" ~ tan" 


ffo 2 -* 2 ) 

a(^ 0 2 +0) 2 ) 


Now, 


and 


;in (/3t + <^) = sin [(/3t + \p - a> t) + &>tj 


sin [(/> ~ 6^) t + tyi/J COS cot + COS £(/3 ” co') t + *] sin o>t 


C[(a 0 -a) 2 + /32 ] 1/2 


/32-v 




* Gardner, M. F., and Barnes, J. F., "Transients in Linear Systems,” New York: John Wiley & Sons, 1942. Appendix A. 


(B2c) 


(B2d) 


(B3a) 


(B3b) 


(B4) 


(B5) 
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By making the appropriate substitutions for A, B, C and a 0 of Equations B3c and B4 into Equa- 
tion B3a, then Equation B3a becomes 


y(t) 


2 OLO 


, x ^o Ke " at 

(/? 0 2 -cJ 2 ) cos cut + 2olo sin at ~ ^ ~ 


/^ 0 Ke' at 

|^(/3 ~co) t + 0J cos cut ~ p 


[(/3 - 



2ato 

K 


— sin (cot + e ) 


2 oxjo - 


A> K 

0 




-p Ke ' 




2ojjo . 

- sin (cot +0) 



{ 


2aaj cos 


[] +(/3 0 2-co2) sin []} 


2aco 

- -jj r- sin (tot + c?) 



2/3 o 

T 


e at cos [(/3-co) t+0-0j , 


where 


K 2 - (/3 q 2 - co 2 ) 2 + 4a 2 to 2 , 


(B6) 


(B7) 


0 


tan 1 


2ato - K 

/y - - 


Po 
0 e 
K/?o 

' 0 


cos [(/3 - to) t + 0j 
e -at sin [(/} - to) t + 0] 


0 


2^-co 2 
tan 4a r 


Now 


2ato 

~Y~ 


2ouco 

(j3 0 2 -v 2 ) 2 + 4 2 cc 2 co2 



(B8) 


(B9) 


(BIO) 


So letting a = wb, as found in Appendix E, the envelope of the output is: 


e(t) 




e _7TBT sin 2 


(Bll) 
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where p-o> is the frequency offset. When p-m = o , then 


e(t) 



(B12) 


where d = pjp. 

Response for t > t 

The response for this case is the same as for the rising end of the rectangle except for the 
sign. For the simple case of no offset 


e(t) = V 0 de" 77B < t - T > = ( 1 - de~ 7,BT ) de _7rB(t "'h , 

where V 0 is the initial condition. 

A simpler derivation of the above expression is given in Appendix A. 


(B13) 
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Appendix C 

Generalized Filter Outputs in the FSK System 


Using the results of Appendix B, the output of the mark filter y(t), due to a mark frequency 
[co 1 - fi 1 ) applied during the first period (0 < t < T) and expressed by 

[u(t)-u(t “T)] sinwj t , 


is, assuming ttB 2 / 2/3 x « l, equal to* 


y-(t) = (l-d 1 e- B T)d 1 e-B( t -T) sin . (C 1) 

So the output at the k th sampling instant (t = kT) is: 

y mn , ( kT ) = y mm k = (l-dj e' a )d 1 sin(a>, t + 0, ) K>1. (C2) 

Similarly, the output of the mark filter due to a rectangular input of a space frequency, co 2 of the 
form 


4>- 4> 


The envelope of the above term is much smaller than y mm and is identified as the crosstalk. 

The sinusoidal term in Equation C 3 indicates that the crosstalk is periodic with a period l/Afj 
where Af x is the difference between the space frequency and the mark filter center frequency, 

(p x ~ Similarly, the crosstalk in the space filter would have a Af 2 equal to the difference of 

the mark frequency and the space filter center frequency, (/3 2 - C 0 1 )/2n. 


(l - de”" Bt ) 2 + 4de _7rBt sin 2 

(P? ~ * 


^1 ‘ “2 + 


2nBco n 


+ 1 


1/2 

sin { go 2 t + 6 2 ) • (C3) 


*The first subscript refers to the mark filter and the second to the waveform applied; also see Figure 1. 
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The crosstalk amplitude is bounded by the expression 


1 + d 1 e~ nBt 


-i 1/2 



(C4) 


If p x -a) 2 = 27rf D is the data rate, then the period of the envelope of the above term will be 
equal to the period of the data rate, with maxima and minima indicated in Equation C4. 

Assuming, for the time being, that the sampling coincides with the minimum value of the 
expression of Equation C4, the crosstalk at the k th sampling instant is given by 


y ms ( kT ) = y mS k 



a ) d 1 



sin t + 0 2 ) With k > 1 . 


(C5) 


Up to now, y k is the response at the k th sampling instant (t - kT) due to a signal applied 

during the first period as shown in Figure Cl. 

In general, the response at the k th sampling instant due to a waveform applied during the j th 
period is identical to that given by Equations B12 and C5 with k - l replaced by k - j . 

Furthermore, y StS>kH and y s>m>kH are identical to y m>m , k _j and y m , Sfk ^j with the subscripts 1 
and 2 interchanged, respectively. Consequently, we have 



y».m,k-j = (l-d 1 e-)d 1 e“-C'-J)sin(« 0 l t+fl 1 ) , 


(l _ d, a -a ) dj e 


a(k-j ) 


y-...k-j = D t sin K t+e 3 )’ 

y s ,s.k-j = (l-d 2 e- a )d 2 e' a ( k -j>sin(w 2 t+i9 2 ) , 

(l ~d 2 e” a ) d 2 e" a ^ k '' j ) 

y.,»,k-j = D 2 ‘ sin(o; 1 t+0 4 ) , 


MC6) 


Figure Cl— Sketches of the response of a low-pass filter 
to a square U(t) - U(t - T), and to two consecutive 
square pulses of the combined form U(t + 2T) - U(t). 


where k > j and D 2 is clear from Equation C5 
and the statement following Equation C5. 
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Referring to Figure Cl, we see that 



where bj - 1, 0 and k> j. 

Obviously, since the signal at the j th interval is either a mark or a space, one or the other of 
the above terms must equal to zero for a given j ; this is taken into consideration by letting b^ 
equal 1 if the digit of the j th interval is a mark, and zero if it is a space. Similarly, 
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Appendix D 


Comparator Output Signal-to-Noise Ratios 

The general expression for is given by the equation below: 


1 ~ e~ 

ys 


1/2 


(Dl) 


where e~ a + e 2a is intersymbol interference and (e a + e" 2a ) 2 + i/d 2 is the crosstalk. 

1. For a dump type filter all intersymbol interferences vanish and Equation Dl becomes 


1 ~ e~ 
fa 


M) 


1 “ e Q / a 

i 


yS 


Vk 2 + a 2 


Y = Y - Y 
*2 x 3 1 4 


(D2) 


where 


k 2 


(m + 1 )n77 


Pi 


jS. ~ 00. 

J 

2rrf n 


2. For dump type filters with large subcarrier separation D becomes very large and Equa- 
tion Dl reduces to Equation D2, and 


1 - e~ a 

= Y - Y = Y 

ya 2 3 Y 4 


3. If sharp filters are used so that D is still large but there is no dumping, then 

(1 - e " a 

(l + e“ 2a ~ e~ a ) 


(D3) 


1 ~ e‘ a 
1 - e" a 


ys 


1 - e~ 

ys 


2 ‘) . 

(D4a) 

. 

(D4b) 

2a) , 

(D4c) 
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and 


Y 


4 


(l + e~ a + e~ 2a ) . 

ya v ' 


(D4d) 


The relations represented by Equations Dl, D2, D3, and D4 have been plotted in Figures 3a and 3b. 
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Appendix E 


Formulation of the Expressions Governing A Singly Tuned Circuit 

The transfer function of a circuit of Figure El is: 


H(s) 


_S_ 

RC 

9 1 1 
s + LC + RC 


If we let a - 1/(2RC), p o 2 = 1/ (LC), p 2 = p 2 - a 2 and s = jcjy then 


H (*>) 


j 2 cuco 

- co 2 + P 2 + j 2aco 


- j 2cuo 

CO 2 - j 2 OAJ - p 2 


(Ela) 


(Elto) 


To solve for the bandwidth, B, we must find the 3 db frequencies m 1( -^ 0 t A by using Equa- 

tion E2a: 


| H {Po ) | 2 = 2|h(/3 0 ±A)| 2 . 

Putting H(c») in a more convenient form gives 


and we may find that 



2(2a) 2 


(2a) 2 + 


(/3 0± A)- 


(>o ±A ). 


(E2a) 


(E2b) 


(E3) 


By rearranging terms, we have 


a 2 (/3 0 ±A ) 2 




For a high Q filter P Q » A, lP 0 > A), and A^a. Then 
2jtB = 2A = 2a (radians) and B = a/ 77 . 


Figure El— Singly tuned circuit, where R repre- 
sents the combination of the source output re- 
sistance and the coil equivalent resistance. 
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Appendix F 


Definitions 


a - ^BT 

B = The 3 db bandwidth 



E = The average signal energy per bit 
f D = The data frequency = 1/T 



N 0 = The noise power density per unit bandwidth 

|^1 ~ a 2 | _ | P 2 ~ ^1 | 

H “ 277f D = 277f D 

<P> = The average bit error probability 
p. = The bit error probability corresponding to input i 
P(M) = The probability of a mark 
P(S) = The probability of a space 
P(M/S) = The probability of a space changing to a mark 
P(S/M) = The probability of a mark changing to a space 

S/N = The signal to noise ratio (average signal power to average noise power) 
l 

a ~ 2RC 776 

p = |^ 0 2 - a 2 ~ fi Q for narrow band circuits 



p = The resonant frequency of the mark filter (radians/ sec) 
P 2 = The resonant frequency of the space filter (radians/ sec) 

o) 1 - The mark frequency (radians/sec) 
oj 2 = The space frequency (radians/sec) 


NASA-Langley, 1965 


G-627 
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